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-ABSTRiCT ' 

Traditionally, lost rehabilitation centj^rs have 
evaluated a clients* vocational skills on an individual basis. 
Individually administered vcrk samples, however, may not provide as 
much individual attentipn to the assessment process as is us^ually 
assumed, Tvo types' of^ group vork sa^mple evaluation syst'ems have beeq 
developed: the ?alpar Berk Sample #14, Integrated Peer Performance, 
in which clients work' cooperatively on m assembly line task; and the 
Hicro-TOSBE System of Vocational Evaluation, The Bicro^TOWER system 
consist£i of aj series of vork samples covering verbal, numerical, 
spatial, motor, and. clerical-perception skill.s. The evaluation takes 
place is a separate room, and each of eight to ten clients are 
provided vith an identical set of necessary equipment. During a 
practice period, t^e. evaluatox demonstrates the «crk*sampl9, and 
provides assistance to the clients as they practice. During the 
evaluation period, clients vor>c on their own. Some of the benefits of 
group evaluation include increased interaction . between the evaluator 
and client^ cost benefits, interaction^ between clients, and the 
sapportit.e atmosphere. Some administrative problems, such as staff 
resistance, sp/ace requirements, staffing increases, and costs, should 
he anticipated, (Bi) 



/ 



♦ Reproductions supplied by EDRS are the best^that can he made ♦ 

♦ from the original document, ♦ 



V 



oo 



THE FEASIBILITY OF GROUP EVALUATION IN 
REHABILITATION AGENCIES 



US DEPARTMENT OF HiAUTH. 
EDUCATION AWELFAltC 
NATIONAL IN$TlTt>TE OF 
EDUCATION 

•m,s OOCuV€NT mas 86EN «6PR0* 
::^CFC EXACTLY^i? PECEivEO FfiOA* 
-Hg PERSON 00 OPGAMZATiON OfiiGtN. 
A* SO I 7 PO'S^S OP VIEW Oft OPINIONS 
S'ATED 00 SC^ SECESSAPiuv REPfiE- 
SEN^OPt^ C AL NATIONAL INST) TUTE OF 
EO^CA^ ON POS'TiON OP POCiCY 



!>ermiss!On to reproduce this 
material has been granted by 



TO TME EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) AND 
USERS OP THE ERIC SYSTEM 



Margaret E. BackrrJan, Ph.D. ^ ^ 
Director, Vocational & ^ ' 
Social Science Research 
ICD Rehabilitation & Research Center ^ 
<New York, New York • , 



O 



Paper presented at meeting of Michigan Association 

of Rehabil itation Facilities, Kalamazoo, December 1977, 



,2 



drafting, another *on filing, '^ind so ^n.\ The evaluator moves around 

the room, coming* to each one to exp1airt,the task, to assist with 

' , • . ^' . • . " > 

any probl ems arid later to score the .work sample • 

/ ' ' 

We seem to have concentrated mainly on the individual 
"approach in our evaluation process. This* is probably because we 
have relied heavily on \hd workshop .situation and. work samples. 
The first wo^r1<. samples v/ere , designed to be given to one client at 
a time (Rosenberg', 1977)-. - The ejarliest v/ork saiiiples, now known ^ 
as TOWER, we^e originally developed in the mid 1930*s at the Iristt- 
tute for Iha Crippled and Disabled in New York City; (Sgveral 
years ago the-agency changed its name to the ICD Rehabilitation 
and Research. Center) . Over the years the TOWER viorV sample ^jiproachr 
became an accepted fopi of vocational evaluation both nationally 
and to sojue extent internationally. In recent years,, other wo^k 
samples have* become coninercial ly Available, Itost^'of these, however, 
have continued to pattern themselves after the TOWER concept, i.e., 
they are adm'inistered on an individual basis. 

It is important .to note that this is not individual, 
one-to-one evaluation, as we know it from te.sts, such 'as the 
Wechsler Adult Intelligence Scale (WAIS), In these tests, one 
evaluator works with just one_ person throughout the entire evaluation 

f r I 

In rehabilitation we pride ourselves that by letting, 
clients work individually we are giving individual attention; 
Tha]; we are offefirt^ e^rh person a program- designed to. meet his or 
her needs and interests/- Bilt .i§ ' tfits ''generaTlys^true? It is trkely 
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that If a clos^e examination were made of most work evaluation 
units, we would find the situation-not quite 6S ideal as we would 
li,ke. ; ^ 

ARE HE PROVIj)ING SUFFICIENT INDIVIDUAL A^ENTION? - 

Let u%co/isfaer individual attention. ^What is the typical 
work evaluation unit ^1 ike? An evaluator, under ideal conditions, 
has six to eight cl ientsxy/orking- on differ^ent tasks. While helping 

one'client, the evaluator is not interacting with the other clients 

\ 

nor is he/she observing them. Also,^ince -the* evaluator can only 
help one client at a time, other clients who need help must wait. 
In addition, since the cl ients are working, on .different tasks and 

of^en not §^tting near one another, they cann9t benefit from 

• • ' • 1 ' ■ ' ' 

explanations given to others, ' 

It would be interesting to do a study to see what propor- 
tion' of a (jiven cl ient ' s, time in evaluation is niomprised of the.^-- 
evaluator's making observations and interacting directly with the 
. cltent. The results would be surprisin;g to some, as the propor- 
tion is- probably qui^ low. One-reason ma/ be the kind of traijiing 
and amount' of experience the evaluator has had,' Other reasons 
become obvious if you look at a typical evaluation unit. 

With individually administered work samples the evaluator 
mu^t move from client to client, spending only a limited amount 
of time with each one. In addition, evaluators, particularly in 
* smaller facilities, are called to the phqne, interrupted by other 
' staff members, called to brief meetings, engaged in conversations 
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by staff and'clients, and asked to fill out large numbers of forms 
and reports — all while they are supposed to be 'obser-ving clients* 
.behavior and work performance. . . v 

It is true that for some purposes it may be ne.cessar.y to 
have clfen-ts work bn their bwn, as they may h-ave to on some jobs. . 
But let's not delude (jurselyes into thinking that this is neces- 
sarily the best or only kind of individual assessment. And let us * 
hot pretend that this is comparable .to individual one-to-one 
assessment, where the evaluator works only with one client through- 
out the entire evaluation period. . ^ - - 

Some questions ^that rnust be answered are: Does the current 
practice of individually administered work samples help us to learn 
as much about clients as we can? Are we confusing assessment of 
skills with .observations of general' work^ tolerafice? And related 
to this, are we 'evaluating clients as efficiently as we could? 
And, are we aivi^a them th^g^^oncentrated attention required for a 
thorough evaluation? ' 

ARE CLIENTS RECEIVING ^VALUATIOt/ PROGRAMS DESIGNED TO MEET THEIR 
INDIVIDUAL NEEDS? ' ~ 

A.'Took at the work samples given to cl ients ^within an agency 
Will usually reveal that most tend to t^e given t)ie same v/ork samples 
This may be'because the agency only 'has a limited number of work 
samples, or because the evaluators are only comfortable adminis- 
tering and interpreting, a half dozen or so'. More extensive a^nd 
thorough 'traininrg in work sample evaluation would help evaluators 



broaden their understanding of what is available and appropriate 
to use. • 

If there are only limited job opportunities in the area and- 

* * 
work samples are related to these jobs, then a common battery of 

work samples could be* appropriate. Also, if the common battery 
provides a-mea'sure of basip aptitudes, then this could be •j^stifi- 
able as well. But usually the reasons are ava-ilabili ty of work- 
samples and a sense of comfort with what is known^ Neither of these 
reasons lea^ds'to evaluation programs geared to individual need,^ ^ 

Now that we have looked critically at individually admin- 
istered work samples, let it be said again that there is a plac^ • 
for them within the work evaluation process. Some clients do work* 
' better -on. their own; some clients do need intensive evaluation in 
special areas. Behaviors, such as perseverance and the ability 
* to perform tasks'over long periods of time, are sometimes better 
'.evaluated- by the individually administered work samples. What 
^is needed, however, is a. combination of group and individual eyal- 
'uation'. The two methods* can supplement each other: In this' way 
we get m^re 'information on our clients, and a more var^iedv kind of 
information. In addition client and stciff time is utilized more 
' efficiently. ' < ' • \ 

^ ' » \ 

. A LOOK AT GROUP EVALUATION \ 

-Now let us exan:ine group evaluation more closely. Group 
evaluation with work .samples is new. Presently it takes two, forms, ■ 



One involves a cooperative situation in which clients work jointly 
on a task. This is illustrated by the Valpar Work Sample #14, 
Integrated Peer Performance, recently developed by the Valpar Cor- ' 
poration in Tucson, Arizona. In this work sample, client work^ 
cooperatively on an assembly line task, with. each performing an 
operation in. turn. TMs^wprk sample measures eye-hand coordination, 
motor skills, speed, concentration, and ability to work under stress 
A maximum Of five clients can be tested at one^time. 

The oth^r type of ^group evaluation foll6ws the more tra- 
ditional method used in paper and pencil testing. Here a group 

*of clients is taking the same work- sampTe at the same time: Each 
client has a separate set of equVpmerTt and works on the task 

"-independently from the others .y This form' of group evaluation is 
illustrated by Micro-TOWER, a system of work samples developed at 
the. ICDpRehabi Mutation and Research Center ,in New York City (Backman 
1977, 1975; Loeding, 1975). • " . . 

The Micro-HOWER system consists of a series of wdT^k samples 
covering basic^ocational skills:, verbal, numbericcil, spatiaJ, 
motor, and clerical-perception. Much of what* we '-know about group 
evaluation with work samples is based on over four years of experf- 
'ence with Micro-TOWER— experience at ICO as well as at the 18 sites 

that were part of the national field testing. 

\ ^ 

* As group evaluation with work samples in.,new, let us use 

) ^ 
the Micro-TOWER setting to illus^trate the techniqi/es involved. 

The evaluation takes place in a separate room where a number of* 

« 

tables' have been pushed together, forming a large surface similar 
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to a conference table., (Other arrangement^ such as. a u-shape ^are ^ 
also possibfe). Clients are seated 'around thes^ tables, each , 
having an identical set of equipment. For example, if the \^ork 
sample 'is Drafting, each clienl would have a drafting board, 
t-square, compass,^ set of sample designs, and so forth. The 
evaluatqr would also have a set of equipment for demonstration 
purposes. , * ^ 

(Micro-TOWER has standardized administration and scoring 

procedures. Standardized testing procedures caa be used with 

I* * 
both group and individually administered tests; they are not 

unique to group -eval uation. The pros and cons of standardized 

testing will not be dealt with in this paper so that we may* con- ' 

centrate on the main issue, group testing). • , * . 

In the beginnihg of each Micro-TOWER work sample the clients 
are shown photos* of persons in various jobs requiring the same 
skills as the work sample, these photos are intended to expand the 
clients' awareness of the world of work^They' ^Iso demonstra:te 
that mapy jobs require the same skills as those assessed by the 
work sample. The clients are then shown how to/do the work sample; 
time is allotted for practice. During this period the evaluator 

can provide help as heeded. The last part of the work sample is 

/ 

the evaluation period, during which time the.cljents work on their- 
own with no help frofcthe evaluator. 

Following each work sample, clients fill out forms reporting 
on l?ow well they liked the task, how well they thought they did, 
and whether or not they would like a job in that area. At the end 



of- each day, a graup discussion is held. At the end of the entire 
evaluation, the clients are given feedback on thejr performance, 

BENEFITS 6F GROUP EVALUATION , 

Now what are some of, the benefits of group testing*? Why ; 
would an agency decide to'add this kind of e^valilation to an^already 
functioning work evaluation unit? ^ ^ . 

The Ever-present Evaluator; . - , 

In the group situation, as illustrated by ]^icro-TOWER, ^- * 
the evaluator is always in the room with the clients and is readily 
available to them. This provides supportive environment, 'as the • 
evaluator can offer eacouratgement and assistance almost in^mediately. 
This is extremely important when one ;»s dealing with persons who 
have emotional problems and low frustration tolerance. 

^ ' , 

Jhe steps for learning the Micro-TOWER tasks ^ small enough so 
that clients with little experience can grasp'what is expected of them; 
they also have a chance to practice each ta§k before being evaluated. 
As the evaluator is readily available, those' having problems need |iot 
wait long for help. Also, since all are working on the same task, an 
answer to one cliefit^'s ^ue^ion Is often of benef tt» to alK_ When the 
evaljjator is helping one^cVig^,, others can observe and learn, since 
they are all woVking on essentially the same task.* In this way the 
group learning period becomes more effective and efficient thar\*that 

of the individual evaluation: In fact, more individual attention can . 

\. ^ * 

'-, -8-10. 



^ actually,^^given in the group setting. 
Cost Benefits - , ' . • 

~~~~ ^ ' 

Is group evaluati^ more efficient than individual' evaluation; 
is* It more cost effective? Fbr paper and pencil tests, 
group testing is usually more cost effective. For v/ork samples 
this js;Jiard to answer. The group setting may mal<fe it possible to 

r 

work with a large number of ql.ients at a time. But, in many 
sta^, rehabil i4:ation regulations stipulate that evalua tors are 
to work no more than six to eight clients at a time. In situations 
where this nunii)er need^ot b^ adhered to (e>5. , -Schools, perhaps 
initial screening^f ^cl i^ts) , more people could be tested .one 
time. This woyld improve ihe cost-benefit ratio. 

• Depending-upon the severity. of the mental and physical con- 
ditions, one evaluator can usually evaluate up to^ ten or twelve . 
clients in a group. Larger groups have-not yet been triec^, but 
with relatively able populations there would se*em to be no reason 
why they could not be accommodated. An aide may^^bejieeded if they 
group size exceeds ten. Also wi"^k^ larger 'gro.up there may be a ^ 
need for clerical help with scoring; and additional tim.e would 
be needed for the writing of reports. " ^ 

Space IS another factor that must 'be considered when the 
group size is increased. Sufficient room must be available to 
accommodate the equipment the clients will be using. A rrdom 
225 square feet should be adequate for testing six or seven clients. 
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V Another, 'often overlooked benefit of group evaluationf, 

) -A ■ , • . 

is that more equipment is available with each wark sample than is 

true for the individually administered work, samples . This is so, 

because^ each til ient in the giN^up requ'ires a set of materials. 

For example, to evaluate seven ctients with Micro-TOWER Drafting, 

the necjessary equipment would incline e^i^ht drafting boards (including 

.one fo»^ the evaluator) eight t~squares, eight compasses, and scf on. 

To evaluate seven clients on all V3 work samples, one v/ould get 

9l sets of work samples (13 work samples x^7 clie'nts per group) ^ 

plus' one each 'for the evaluator. The cost of these 91 wgrk samples,* 

pljjs the 13 for the evaluator, is $5,015. To obtain the same 

number of sets of individually administered work samples, 'one would 

typically have to spend. tens of thousands of dollars. Future . * 



innovations may result in different financial breakdowns, 



Client Interactions * ' ^ . 



We tell ourselves that work evaluation, units resemble a 
real work setting. Close examination would show that this is true, 
but only to^ a limited extent. For one thing,. with the individually 
adHfilnisterpd work samples-, thii^r.e is very little interaction amongst 
workers; 'this is -not always true on-the-job. - ' / ' 



Adding group administered work samples td the evaluatiotf^- 
Uttit makes it possible to see cl iejits. in'^a sHuatiQiHn which w ^' 
they are working with-others.\ This is important as many persons 
fail on jobs, not because they -lack the requisite skills, but* 
1)ecause of social' adjustment problems.. Both the Valpar and Micro- 



. TOWER group work samples ppQVide opportunities. for observtng how 
• clients will interact with others/ ' * . * * ^ 

The Valpar work sample #1'4 simulates an assembly Vine wh^re 
the person's actual movements are relates! to what others are^doing. * 
In Micro-TOWER, the cl'ient interaction is not related to wording on 
the specific task* as it is in Valpar, Here the clients Work independ- 
ently on ea(;|^^ work sample. As they* are being evaluated in^a^work 
, • situation, with others, very go^- observations can be made of their 
. ' interaction with'' other workers: Are they supportive of others during 
the learning and discussion periods; how do they interact with the 
^ other workers; how do they relate to the ^supervisor? 

' Clients^ Preferences fpp Group- Evalu ation 

^ ~. ^ 

Now le,t us look at group t^stiag from th€ clients/ point of 
view. Do they prefer to be evaluated slone^^r as part of a group? 

' Persons unfamiTiar w^h Micro-TOWER often ask if the group situation 
isn't cojTipetitive ^and^^^d^^sx^ produce anxiety in clients. This may 
be true for some, but^xperience has shown that for most clients 

■ the group situartion can actually be a supportive'one. 

Group assessment heed not alv/ays be competitive or pressured. 
In Micro-TOWER, only a few work samples involve speed; on^the other 
work samples sufficient time is allowed for most clients to complete 
the'ta^k. The situation is not competitive, ^by and' large. Time is 
* allowed tor practice, and experience has shown that members oT the 
group, as well as tfie evaluator, provide support and er jouragement 
^ ^Ijppihose who feel frustrated jDr express negative feelings about therti- 

ERIC 48 , 



selves. Also, on actual jobs most persons work with others, either 
direqtly or indirectly, even if they do not work cooperatively on ♦ 
a task, If*a client cannot function with^ other people^ even where, 
there is some structure such as Mtcro-TOWER, then you have learned 
something: the cliertt may not be ready for employment. 

, Let us remember that evaluation is anxiety producing whether 
you are -a client, a student, a professional^eing evaluated for 
certification, or a person taking a driver's test (a work sample, if 
there ever -was^qne). ^Clients frequently come into a evaluation not 
knowing what is going to happen to' them; .they may become intimidated 
by all the professionals talking to them - or -ignoring them as the 
case may be. It is a new, strange situation,^ and they have a .lot , 
at stake. * ^ 

During the deveTopmental stages of Nfcro-TOWER, we conducted 
a survey to see how the clients felt about group 'testing. We randomly 
selected a group of clients who had taken both Micro-TOWER and 
individually^administered work samples. ;They'were given a very 
sim]^le questionnaire asking which they preferred: About two-thirds 
of the clients preferred the group evaluation (Backman, Loeding, & 
Lewis, 1975). ^ 

About th.is same time, evaluators were noticing that they 

could tell which clients had been prwiously evaluated in the 

group setting. Not 'all the clients at ICD had taken the group work 
\ 

samples, and what the evaluators were observing was that those who 
had ha'd the group' experience were moj;;e "socialized". Most clients 
who come to ICD know no orre on their .first day. For several days or' 



weeks they ijiay go to lunch alone, take I)reaks alone, and feel isolated 
from others. Those who have had the group experience, however, 
establish a social unit. that lasts for someti'me, (One Evaluator has 
informed me that there has been. at least one Micto-TOWER marriagel). 

A later study of client self-concept supported these obser- 
vations (Fingerhut, 1977). This study revealed that clients* s^lf 
concepts became more positive after a week in group .evaluation. 
Unfortunately when they then went into individual evaluation, their 
seH^ concepts became almost as poor as they had been before th^ 
group process. 

The reasons for these changes in self-concept need to be 
investigated. However, it appears , that something good is happening 
in the group setting. Perhaps it is the supportive environment, 
^ the immediate attention of the evaluator, the encouragement or presence 
of .other -clients. Maybe misery just loves company^ 

• INTEGRATING GROUP AND INDIVIDUAL EVALUATION 

As stated earlier, there is a place in most rehabilitation 
agencies for both group and individual evaluation. Some clients - 
work be1;ter in groups; others perform best; when working alone. In many 
CcTSes seeing cliecvts fn both situations provides the most useful 
infortiiation. In this way the right job setting can be Recommended. 



On'e Way integrate group evaluation irito an agency is to 
use it as a screening device for further evaluation or training. 
This is possible with Micro-TOWf^, as it provides .a profile of basic 
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aptitudes'. It can be the first step in an evaluation program; ir> 
this way/^e clients $tart out in a supportive environment and form 

r 

a social unit. Observations can also be made of the, clients' inter- 
actions in the grou^. Their performance, as indicated by the aptitude 
profile, can be used to direct them to areas where more intensive 
Evaluation is needed^ This additional eval uatioa can then be done 
by individually ,adoiinistered w(Jrk samples. Since these work samples 
usually take much Jong^r than group ^work samples, fev/er of them^ need 
to^be given. Thi5 provides a more efficient and effective fSrm of' 
evaluation. In'§ome cases, clients may be referred directly into 
traijiing; in cfther cases further evaluation may be delayed until 
behavioral or personality problems are d^alt with. 

r ^ 

POSSIBLE ADMINISTRATIVE PROBLEMS WITH GROUP EVALUATION ' 

• 1 - 

^ By now you may feel that it might be- a good idea to intro- ^ 
group evaluation into your agency. But you should be aware of 
le problems you may have to deal with. ^ 

'STAfF RESISTANCE - ^ 'V ■ ■ 

• * < * 

As mentioned earlier, group , evaluation with v/ork samples 

IS new. Anytime something new is introduced into. an on-going operation 

there tends to be some resistance. Some resistance may be good, as' 

it forces one to think through and to justify what; is*being done.* 

Some resistance, however, maytome from a fear of^the unknown: Is 

this going to make more work. for me; Is it going to generate more 

papey work; is it realjy different or better than what I have' been 




doing?' Yes, there i-s much comfort^ the status quo. If something 
has b6en working, "^y change it? \. 

Inservice/Educzition ^ ' 

* , Whenever a new procedure is to be introduced into anr. 
organization,* time should be devoted to educating and training staff. 
As soon as possible, staff input' should be encouraged.! Once the 
'decision has been made to proceed with the new operation, all staff 
should have a thorough exposure to the new system. Administrators, ' 
counselors, evaluators, -and clerical staff should be included in 
the inser^ice education. Any changes in operational procedures 
should be clearly sp^elled out, and ways for malting the changes 
occur smo6j:hly should be presented. The inservice education is 
usually not accomplished after one meeting, but requires a series^ 
of meetings to answer questions and to work out any possible 
problems. 

The' Involved Administrator 

The catalyst for making a new operating procedure v/ork is 
ihj involved administrator-. The irtvolved administrator is copmitted 
to the idea that the new procedure will work ^and conveys this 
committment ^and enthusiasm to the staff. One way this involvement 
Is demonstrated is^by making the necessary decisions as quickly as 
/possible; this insures that Operations will follow smoothly. ' 
Jhese decisions take the form of allocating space, hiring staff, or 
allocating funds for purchase of equipment. 

.17 
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SPACE REQUIREMENTS . ■^:7--Y,; 

'A suitable testing areamust be found for the grpup 
evaluation: The room should have adequate lighting, ventilation/ 
furniture, and storage space for equipment. If the evaluation^ 
system is standardized, as is Micro-TOWER, a separate room v/ith a 
closed door will be needed. This is to insure that the standard- o 
ization procedures will be maintained and that cl ientVwil 1 not be 
distracted during the learning or evalu^ion periods. An fnterrup- 
' tion can affect a client *s score if it takes place during -a timed 
evaluation. 

Some might say evaluation in a sbparate room does^not 
resemble a real work situation, but- one haf^!to decide what the 
goals of the evaluation are. If what is needed are objective, 
interpretable results reflecting a person's basic, skills, then * 

• distractions only confound' the interpretation of results. If you 

' " I ** 

wish to evaluate how well a client tolerates distrac]|ions,' then 

yoli should devise a work sample specifically^ for that purpose. 

^ \ ■ . 
' I 

STAFFING • j 

• * 

It is usually best to have more than one evaluator trained 

''1 

to-do the group evaluations. This is partitjjulariy important if 

* 

•standardized work samples and tests are used. ^Evaluators can alter- 
^ nate giving the work samples; and can substitute for each other 
during vacation times or sick leave. Also, time should be allocated' 
for training of staff in the work sampTe^administration . This may 
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be days or weeks depending upon the system: for Micro-TOWER it * 
is a minimuni'of two days. 

Clerical help is also usefuT^or the scoring^ of * work samples 
This i's particularly true when the reports are needed soon after the 

m 

evaluation period 'has been* completed. Making such help available 
to the evaluators hel^Bs^lleviate some of the concerns about 
( increased work load. An aide may also be needed,^ if the group 
size is Urger than ten'. 

COST _ . ' ^ ■ 

c 

Tfie cost of a work sample system is another problem that 
.must be dealt with; Most of those available commercially, whether 
individual or group adminis.tened, run in the thousands of dollars. 
• With a group -system, such as Wicro-TOWER, however, you a^,e getting 
much more equipment for your money than with the individual systems.^ 
This is because' for a' given work .sample there is enough equipment 
to test several clients $t a time, whereas with individual work , 
samples there is only enough. for one Client. 

One question ^ou may be asking yourself is why you v/ould 
want to purchas.e a system rather ^thltn develop one in-house. Some 
agencies do both. But "it is costly to develop work samples. This 
requires .time, money, and skilled staff. 



^Commercially available systems have several advantages.., 
Many ?ilready have norms available. Some have documented 'evidence of 
their reliability and validiw. The commercial systems have been 
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tried out and ypu can evaluate their usefulness before expending 
time^'and money. You" also have the benefit of the skilled profes- 
sionals who developed Afie system, and who will provide technical . 
assistance. , In additiqi/ .the equipment is often of better quality 
thafi you can get ^'because -it is purchased in quantity or has been 
specially designed, ' , ^ * ' . 

* it ' , 

' Comi\iercially available work samplqs have , been criticized 
as too costly',- On the surface' i-t: would appear to be, if one only 
looks at the actual hardware. But the developmental costs are 
high.. Typically it takes two to three years t'o develop a system, and 
^on-going research and expansion of the system must go on. Highly 
trained professionals have contributed their lexpertise to the design 
^f the work samples. (I am speaking of the bett'er systems ; there 
are always those thai do not meet standards in sny market.), 

^ Assuming that you are willing to purchase a work sample ■ 

system, how can you afford i^ One common way' is to write the work 
samples into grants, such as CETA grants. Most developers of 
samples will hcive someone on Staff to help you in the area of selec- 
ting and writing grant's. Seek out these specialists and plan ahead. 

.. WHERE DO YOU GO ^R'OM HERE? . ^ 

Before investing in any new procedure, learn as much . 
about it as you can. To do this, involve as man/trained specialists 
as you^have available:' pSychologis^, counselors, evaluators. If 
you don't have a staff member trained in psychometrics , it could ^ 

be worth your while to invest in a consultant, such as a university 

■ ' % ' ' ' 

^ ' . *. C>0 / , 
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professor,- psychologist, or. rehabil itcition professional with a J 
speciality in measurement or evaluation • ' r 

^ 

Get all the 1 iterature you ,can. Ask for manuals describing 
the system and reporting technical data, such as reliability and 
validity coefficients. See if there are norms available for 
clients similar to those you serve; these norms will give you an 
indication of the v/ork samples' appropriate level of difficulty 
for your clie>^s/ The trained professional 'can help you interp<,et 
this technical data. ^ . - • ^ 

Don't be overly impressed by fancy techno^logy and equip- 
ment; make sure Jhe equipment is sturdy ancf durable. Get the names , 
of other users and find out how they like the system* and how they 
are using it. Check the repair record. Find out' if ^here are 
warranties. Also find out how much consJmmable material there is, • 
so you can budget for it. ' ' 



^. Attend \conference5, go to exhibits, request' slide shows 
from the produc^Sof^ f rom the Material^ Development Center at the 
Rerabil ttatfbn' Institute, University of Wisconsin-Stoat^Menomoriie, 
Wisconsin). And ^^-^^6ssi blo^ajytt other centers using the system. 



Have the consultant advise you how to integrate the new 
system into 7our agency. This way you can make the best use of the 
results 

And most Importantly, ask. yourself what you want to get ' 
out of this new system; what^.sorts of questions. do you v/ant it 

A ^ ^ . ^ • 

to answer^. Be specific, for ohTy then c^an you evaluate your own 

needs\ » ' ^ 
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( , SUMMARY 7 . ' " 

There s'eems to be a place in wprk evaluation for twth 
group and inii^ividual assessment. Up to this time, individual assess 
meht with work s^ampTes has been- the mainStay^ of v/ork evaluation • 
units.. Recently work samples have been developed^that can be • - 
, admipi'stered' to small 'groups of clients. . 

.\ The group approach provides a sufJportive environment, and 

• •* < 

^a]lows the opportunity to observe how a person works and interacts 
with others. The group approach can also be, more efficient and 
cost effective: The evaluator i-s always hand, providiTig help 
that i^ useful to jnore than one client at a time; j'p certain 
settirfgs one ^valuator can v/prk with more clients than' is pc^sible 
in individual evaluation. 

Tfte individual approach, ort the other hand, allows for 
more intensive evaluatian in more^limi ted areas. It also allows 
clients to work on their own and frequently at their own pace. 

By us'lng both approaches, one learns about cj ient ^s^^v/ork 
behavior when working wi th-^ otrrers and v/hen working^ alone; this can 
lead to more^-^ppropriate Selection of jobs or trajning programs. 
Following the group evaluation, individually administered v/ork / 
samples can be used foi" more intensive assessment, / These work 
samples^ may be in an area where ^the client has' performed well Jfv^ 
has shown an interest during the group evaluation. 

• 4- ^ 

Introducing a new system, such as gr-oup evaluation, into 
a rehabilitation facility requires the attention, cooperation, and 



involvement of admjnistr^c^feors^ as well as counselors and evaluators, * 
?he administrator help by seeing t^at testing space is made 
available, staff hired or trained, and 6'lerical help provided where 
needed* In-service training^programs must be set up for ^11 staff, 
so that the new .operation m]\ run smoothly. And last but not least, 
fiki'ds must be secured for the purchase of the new equipment • 



. ' Work evaluation is not solely^ the responsibility of the 
evaluators and counselors, > Administrators must become niore involved 
in seeing that the new approaches are. accepted, and properly integrated 
into the* agency. - If not, the resistance and fears of the staff 
about the possible failures of aTiew system may result in the 
Self-fu] filling Prophecy. 
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